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Abstract 



We consider QCD tt'j and ttZ production at hadron colliders as a tool to 
measure the ttj and ttZ couplings. At the Tevatron it may be possible to 
perform a first, albeit not very precise, test of the tt'j vector and axial vector 
couplings in ti'y production, provided that more than 5 fb~^ of integrated 
luminosity are accumulated. The ttZ cross section at the Tevatron is too 
small to be observable. At the CERN Large Hadron Collider (LHC) it will be 
possible to probe the tt'j couplings at the few percent level, which approaches 
the precision which one hopes to achieve with a next-generation e~^e~ linear 
collider. The LHC's capability of associated QCD tiV (V = 7, Z) production 
has the added advantage that the tt'j and ttZ couplings are not entangled. For 
an integrated luminosity of 300 fb~^, the ttZ vector (axial vector) coupling 
can be determined with an uncertainty of 45 — 85% (15 — 20%), whereas 
the dimension-five dipole form factors can be measured with a precision of 
50 — 55%. The achievable limits improve typically by a factor of 2 — 3 for the 
luminosity-upgraded (3 ab~^) LHC. 
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I. INTRODUCTION 



Although the top quark was discovered almost ten years ago [1,2], many of its proper- 
ties are still only poorly known [3]. In particular, the couplings of the top quark to the 
electroweak (EW) gauge bosons have not yet been directly measured. The large top quark 
mass [4] suggests that it may play a special role in EW symmetry breaking (EWSB). New 
physics connected with EWSB may thus be found first in top quark precision observables. 
A possible signal for new physics are deviations of the ttj, ttZ and thW couplings from the 
values predicted by the Standard Model (SM). For example, in technicolor and other models 
with a strongly coupled Higgs sector, anomalous top quark couplings may be induced at the 
5-10% level [5]. 

Current data provide only weak constraints on the couplings of the top quark with the 
EW gauge bosons, except for the ttZ vector and axial vector couplings which are rather 
tightly but indirectly constrained by LEP data (see Sec. II C); and the right-handed thW 
coupling, which is severely bound by the observed h ^ rate [6]. In future, the thW vertex 
can be probed in top quark decays to Wh [7-9], single top quark production at hadron 
colliders [10-13], 67 collisions [14], and top pair production at an e+e" linear collider [15-17]. 
The ^7 and ttZ couplings can also be tested in e^e~ — > ti [16-22], and in ttV {V = 7, Z) 
production at hadron colliders [23,24]. Finally, the process 77 tt is also sensitive to tt^ 
couphngs [25,26]. 

At an e'^e" linear collider with = 500 GeV and an integrated luminosity of 100 — 
200 fb~^ one can hope to measure the ttV couplings in top pair production with a few-percent 
precision [19]. However, the process e+e^ tt is sensitive to both tt'-f and ttZ 

couplings and significant cancellations between the various couplings can occur. At hadron 
colliders, tt production is so dominated by the QCD processes qq ^ g* ^ tt and gg — > tt 
that a measurement of the tt'y and ttZ couplings via qq — >■ ^* /Z* ti is hopeless. Instead, 
the ttV couplings can be measured in QCD tt'-j production, radiative top quark decays in tt 
events {ti '-/W'^W^bb), and QCD tiZ production, tij production and radiative top quark 
decays are sensitive only to the ttj couplings, whereas tiZ production gives information only 
on the structure of the ttZ vertex. This obviates having to disentangle potential cancellations 
between the different couplings. In these three processes one can also hope to separate the 
dimension-four and -five couplings which appear in the effective Lagrangian describing the 
ttV interactions. Helicity amplitudes of an operator with dimension n in general grow with 
energy, E, proportional to E"^^. As a result, the shape of the photon or Z boson transverse 
momentum distribution differs considerably for couplings of different dimensionality. 

In this paper we consider tij production (including radiative top quark decays in ti 
events), and tiZ production, at the Tevatron and LHC as a tool to measure the ttV couplings. 
We first review the couplings definitions, then discuss existing bounds on them, as well as 
constraints from ^'-matrix unitarity (Sec. II). In Sees. Ill and IV we present detailed analyses 
of ^7 and tiZ production, including all relevant backgrounds. We derive sensitivity bounds 
in Sec. V, where we also present a detailed comparison with the limits anticipated at a future 
e"'"e~ linear collider. We summarize in Sec. VI. 
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II. GENERAL TTV COUPLINGS 



A. Definition 



The most general Lorentz- invariant vertex function describing the interaction of a neutral 
vector boson V with two top quarks can be written in terms of ten form factors [27], which 
are functions of the kinematic invariants. In the low energy limit, these correspond to 
couplings which multiply dimension-four or -five operators in an effective Lagrangian, and 
may be complex. If V is on-shell, or if V couples to effectively massless fermions, the number 
of independent form factors is reduced to eight. If, in addition, both top quarks are on-shell, 
the number is further reduced to four. In this case, the ttV vertex can be written in the 
form 

q, q) = -ze + ^Aik')) + £ + {^F^k') + l^F^k')) 

(1) 

where e is the proton charge, rrit is the top quark mass, q {q) is the outgoing top (anti- 
top) quark four-momentum, and k"^ — {q -\- qf. The terms -Fi^(O) and -Fi^(O) in the low 
energy limit are the ttV vector and axial vector form factors. The coefficients F^y(O) and 
F2ji^{Q) are related to the magnetic and (CP- violating) electric dipole form factors, gt and 
dl accordingly: 

i^2V(o) = g.^, (2) 

^^2^4(0) = ^ ^7 , (3) 

where Qt = 2/3 is the top quark electric charge. Similar relations hold for -^2^(0), F2j^{0), 
and the weak magnetic and weak electric dipole moments, and df . At tree level in the 
SM, 

P^,SM _ 2 pj,SM _ f. 

^IV — 2 ' ^lA — ^ ' 

?Z,SM 1 / 1 ^ „;„2/) \ t:iZ,SM 



4 sm 6'vF cos V 3 / 4 sm 6'^^ cos 6'^^ 

where dy/ is the weak mixing angle. The one-loop corrections to P^yA vanish for on-shell 
photons [28]. The numerically most important radiative corrections to the ttZ vector and 
axial vector couplings can be taken into account by replacing the factor (1 — 8sin^^i^/3) in 
FiY^^ by (1 — 8 sin^ 6'gyj/3), where sin^ 6**^^- is the effective mixing angle, and by expressing 
the remaining factors of sin6'vF and cos 9w in F^y^ in terms of the physical W and Z 
masses. Numerically, the one-loop corrections to F^va typically of O{10~^ — 10~^) [28]. 
The magnetic and weak magnetic dipole form factors receive contributions of the same 
magnitude [29] at the one loop level in the SM. However, there is no such contribution to 
the electric and weak electric dipole form factors, Fj^ [27]. 
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In tiV production, one of the top quarks coupling to V is off-shell. The most general 
vertex function relevant for tiV production thus contains additional couplings, not included 
in Eq. (1). These additional couplings are irrelevant in e+e~ — > ti, where both top quarks 
are on-shell. Since most of the existing hterature does not discuss them, we ignore these 
additional couplings in the following. 

In e'^e~ — > tt one often uses the following parameterization for the ttV vertex: 



(5) 



Using the Gordon decomposition, it is easy to show that the form factors F^^j^ and F^^j^ 
(i = 1, 2) are related by 

Fjv = - {FYv + F^y) , (6) 
F2V = F^v , (7) 
FIa = -FiA > (8) 
FL = -iF^A ■ (9) 

It should be noted that the Gordon decomposition holds only if both top quarks are on-shell. 
Only in this case are the vertex functions of Eqs. (1) and (5) equivalent. We found that for 
our processes, ttV associated production, using the Gordon decomposition results in gross 
Lorentz violations of the matrix elements. We therefore base our analysis on the form factors 
in Eq. (1) and use Eqs. (6-9) only in Sec. V to compare the limits we obtain for F^^^ at the 

Tevatron and LHC with those hsted in the literature for 

B. Unitarity Constraints 

The parton- level production cross sections of processes such as tt — > VV or tt — > W^W~ 
with non-SM ttV couplings manifestly grow with the parton center of mass energy -\/^. 5"- 
matrix unitarity restricts the ttV couplings uniquely to their SM values at asymptotically 
high energies [30]. This requires that the couplings F^y^ {i = 1,2) possess a momentum 
dependence which ensures that any deviations of the F^y^{s) from their SM values vanish 
for s S> rrif. The precise s-dependence of the couplings is, of course, unknown. The simplest 
possible ansatz is to assume a constant anomalous coupling for y/§ < A which abruptly 
drops to zero at V§ — A (step-function) where the scale A is related to the scale of the new 
physics generating the anomalous couplings. This ansatz is generally used when calculating 
the contributions of non-standard couplings to loop observables (see Sec. II C). Here, in order 
to explore how ^-matrix unitarity restricts the anomalous ttV couplings, we use instead a 
dipole form factor, similar to the well-known nucleon form factor, 

where 

^Fry,A{k') = F^^Ak') - F^y^, (11) 
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and Ai?i7 is the form factor scale which is analogous to the scale A discussed above. 

The values AF^^{0) are constrained by partial wave unitarity of the amplitudes fl tt, 
tt —>■ W~^W~ , tt — > VV and tt — > ZH (where H is the SM Higgs field) at arbitrary center- 
of-mass energies. The most stringent bounds are obtained from W^W~ production in t-t 
annihilation. We find 

967r 1 1 /6.78TeV\^ 



lApZ / Ni 967r 1 1 /5.01 TeVy 

I ^^'^^^^l - TIg; sin cos Wf ^ ' ^ ^ 

Sm Ow J^FF \ ^FF J 

I ^\/,Av y| sm%cos% A|j. V ^i^i^ / 

where is the Fermi constant and 6w is the weak mixing angle. We use a top quark 
mass of 178 GeV [4] in Eqs. (12-15). Our results for AF]^^^(0) are consistent with those 
obtained in Ref. [31]. For a step-function form factor, the bounds on AFjf,^(0) (AF2^^(0)) 
in Eqs. (12) and (13) (Eqs. (14) and (15)) have to be divided by a factor 4 (16). 



C. Present Experimental Limits 

Although there are no current direct limits, precision measurements at the Z pole and 
the measured b ^ branching ratio (BR) provide indirect limits on the ttV couplings. 
Non-standard ttZ couplings and the ^7 dipole form factors, -F^y^^, contribute at one loop 
to the e parameters of Ref. [32]. The 6 — > S7 BR gives additional information on the 
^2VA couplings. Non-standard ttV coupling contributions to the e parameters are divergent 
unless the couplings' momentum dependence is properly taken into account. As discussed 
in Sec. II B, one usually regularizes the divergent integrals by assuming the form factors to 
be of step-function form {9{x) is the step- function) : 

AF^y^^{k') = AFry^^{0)e{A'-k'). (16) 

Extracting information on anomalous couplings from loop observables assumes that no other 
sources of new physics contribute to these observables. 

Non-standard ttZ vector and axial vector couplings, AFfy^, are mostly constrained by 
the parameters ei and e^, which are closely related to the p parameter and the Z ^ bb decay 
width. The terms proportional to AFfy^^ which contribute to 62 and 63 are suppressed by a 
factor / (where rriw is the mass of the W boson) relative to those which appear in ei 
and efe. Using the expressions given in Ref. [6] combined with the most recent experimental 
results [33] and SM predictions [34] for the e parameters, and assuming that the couplings 
AF^y j^ are real, we obtain 
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-0.044 < - AFfj^{0) (1 + 0.842 AFf^{0)) log (^^) < 0.065 , (17) 

-0.029 < -(AFf^(0)-|AFf^(0))log(^) < 0.143. (18) 

For A = C(l TeV), Eqs. (17,18) constrain |AF]^^^(0)| to be less than a few percent. 

The effect of the magnetic dipole moment couplings on the e parameters was an- 
alyzed in Ref [35]. It turns out that F^ affects only 62 and 63 and that these parameters 
constrain only a combination of and F^. Prom the most recent experimental results 
and theoretical predictions for these parameters, one obtains: 

-0.92 < - (F^iO) + 1.83 Fiy{0)) log (^) < , (19) 

-1.08 < -(F2V(0) + 1.83F/^(0))log(A|)< 1.92, (20) 

where again we have assumed real F^. If only one of the couplings is allowed to deviate 
from its SM value, Eqs. (19) and (20) yield 1^2^(0)1 < 0.3 and 1^2^(0) | < 0.2 for A = 1 TeV. 
The effect of the electric dipole moment couphngs F2A on the e parameters has not been 
studied so far. 

Bounds on F^^/^ from b ^ data can easily be estimated from Refs. [6] and [36]. The 
latest CLEO and BELLE measurements of the 6 ^ S7 BR give BR{b sj) = (3.3 ± 0.4) • 
10"^ [37]. The SM predicts BR{b 57) = (3.4 ± 0.5 ± 0.4) • 10"^ [38], where the first error 
is an estimate of the perturbative uncertainties, and the second reflects uncertainties in the 
input parameters. Adding the experimental and theoretical uncertainties in quadrature, we 
find: 

-0.39 < 1.94Re(F2V(0)) + 0.68Im(F2^^(0)) + 0.45 |F2V(0)|V 0.056 1^2^^(0)1^ < 1.11. (21) 

Assuming that F^y and are real couplings, and varying only one coupling at a time, one 
finds that -0.2 < ^2^(0) < 0.5^ and 1^2^^(0)1 < 4.5. 

The tt'-f vector and axial vector couplings are not constrained by any current data. 

III. TT7 PRODUCTION 

For ttj production, as well as the ttZ process considered in the next section, we assume 
the Tevatron (LHC) to be operating at = 2.0 (14) TeV. 

A. Signal 

The process pp — > ti'j followed by t — Wb leads either to a 'yii'ei'i^e'bb final state if 
both W bosons decay leptonically, to a ■yiugbbjj final state if one W decays leptonically 



^A second solution, —5.9 < F^y(O) < —4.1 is clearly inconsistent with LEP data (see Eqs. (19) 
and (20)). 
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and the other decays hadronically, or to a 766 + 4j final state if both W bosons decay 
hadronically. The 766 + 4j final state has the largest BR. However, it is plagued by a large 
QCD background, so we ignore it. The dilepton final state, although less contaminated by 
background, has a BR about a factor 6 smaller than that of the so-called lepton+jets mode. 
In the following, we therefore concentrate on this last process: 

pp 'yiuibbjj (22) 

with £ = e , n {t leptons arc ignored). We assume that both b quarks are tagged with a 
combined efficiency of = 25% (e^ = 40%) at the Tevatron (LHC), unless explicitly stated 
otherwise. 

We perform our calculation for general ^7 couplings of the form of Eq. (1). As we 
shall see, at both the Tevatron and the LHC, photon transverse momenta of at most a 
few hundred GeV arc accessible. The scale of new physics responsible for anomalous tt^ 
couplings is expected to be of (9(1 TeV) or higher. Form factor effects will thus be small 
and are therefore neglected in the following. We also assume that all tt'f couplings arc real. 
We otherwise assume the SM to be vahd. In particular, we assume that the 667 coupling 
is that of the SM. Our analysis for F^y thus differs from that of Ref. [24] for the top quark 
electric charge (Qt) measurement. That study assumed that Qt is related to the b quark 
charge, Q^, and W boson charge, Qiy = ±1, by Qt = Qb + Qw- 

Our calculation includes top quark and W decays with full spin correlations and finite 
width effects. All Feynman diagrams contributing to the lepton+jets final state are included, 
i.e. besides tt'y production, we automatically take into account top quark pair production 
where one of the top quarks decays radiatively, t — > Wb'-f. STibscqucntly. we will refer to 
this process simply as "tt7 production" and it is implied that it automatically includes any 
contribution from ti production where one of the top quarks undergoes radiative decay. To 
ensure gauge invariance of the SM cross section, we use the so-called overall-factor scheme 
of Ref. [39] , as implemented for ttV production in Ref. [40] . 

All signal and background cross sections in this paper arc compTitcd using CTEQ6L1 [41] 
parton distribution functions with the strong coupling constant evaluated at leading order 
and as{rn\) = 0.130, where niz is the Z-boson mass. The top quark mass is assumed to be 
rut — 178 GeV [4] . All signal cross sections in this paper are calculated for factorization and 
renormalization scales equal to m^. 

The acceptance cuts for ^Ivfbbjj events at the Tevatron (LHC) are 

i)T > 20 GeV , 

PT{b) > 15 (20) GeV , \ri{b)\ < 2.0 (2.5) , AR{b, b) > 0.4 , 
PT(j)>20GeV, |r/(j)|<2.5, AR{j,j)>OA, Ai?(j, 6) > 0.4 , (23) 
pr(7) > 10 (30) GeV , [77(7) | < 2.5 , Ai?(7, j) > 0.4 , AR{^,b) > 1.0 , 
Pt{€) > 15 GeV , \r]{e) | < 2.5 , Ai?(£, 7) > 0.4 , Ai?(£, 3) > 0.4 , AR{e, b) > 0.4 , 

where AR = [(A$)^ + (A?7)^]^/^ is the separation in pseudorapidity - azimuth space and is 
the missing transverse momentum originating from the neutrino which escapes undetected. 
We include minimal detector effects via Gaussian smearing of parton momenta according 
to CDF [42] and CMS [43] expectations, and take into account the b jet energy loss via a 
parameterized function. 
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Since wc arc interested in photon emission from top quarks, wc would like to suppress 
radiation from W decay products, as well as emission from b quarks and from initial-state 
quarks. The large AR{j, b) cut in Eq. (23) reduces photon radiation from the b quarks. 
Photon emission from W decay products can essentially be eliminated by requiring that 

m{jn) > 90 GeV and mT{£r,M > 90 GeV, (24) 

where m{jj^) is the invariant mass of the jj'j system. The variable mT(^7;|^T) is the ^7^t 
cluster transverse mass, given by 

mU^r, h) = (Vp^(^7)+m2(^7) + - (pTm + ^t) ' , (25) 

where pri^l) and m{£'~f) are the transverse momentum and invariant mass of the £7 system, 
respectively. The i'-f^T cluster transverse mass peaks sharply at mw- It is difficult to 
suppress radiation from the initial state quarks without simultaneously reducing the signal 
cross section by an equal amount. Fortunately this is not a problem at the LHC, where 
gluon fusion dominates. 

In addition to the cuts listed in Eqs. (23) and (24), we require that the event is consistent 
either with tt^ production, or with tt production with radiative top decay. This will reduce 
the singly-resonant and non-resonant backgrounds, and is accomplished by selecting events 
which satisfy either 

mT{bi,2i; i>T) < mt + 20 GeV and rut - 20 GeV < m{b2,ijj) < + 20 GeV, (26) 

mT{hi,2h\i>T) < mt + 20 GeV and rrit - 20 GeV < m{b2,ijj) < + 20 GeV, (27) 
or 

mT{bi,2i; i>T) < mt + 20 GeV and mt - 20 GeV < m{b2,ijn) < + 20 GeV. (28) 

Here, 61, 62 = b, b, and 61 7^ 62 ■ 

Imposing the cuts hsted in Eqs. (23-28), and before taking into account particle identifi- 
cation efficiencies, we obtain a cross section of about 5 fb (82 fb) at the Tevatron (LHC). The 
total integrated luminosity one hopes to achieve at the Tevatron in Run II is between 4 and 
8 fb~^. While this will not be sufficient for a precision measurement of the tt'-f couplings, 
it may offer a chance for a first test of these couplings. At the LHC, with 300 fb~^, one 
expects several thousand signal events which should make it possible to precisely determine 
the tt^ couplings if the background can be controlled. 

B. Background Processes 

The most important irreducible background processes that remain after imposing the 
cuts described in Sec. HI A, are t(— > bt^v)b^jj, t{-^ b£~iy)byjj, bjj)U~i>^ and t{-^ 
bjj)b£'^u^ production, and the non-resonant process pp W{-^ £v)^bbjj. The single-top 
processes will be collectively denoted as "(^67 -|- tb")) + X production" in the following. We 
calculate the irreducible background processes at leading order in QCD including the full 
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set of contributing Feynman diagrams using MADEVENT [44]. iuj)bbjj production, as 

well as tbjj. tbjj. fM~u and tbi'^u production where the top quark decays radiatively, are 
strongly suppressed by the cuts of Eqs. (24-28) and therefore not considered. 

There are also several reducible backgrounds resulting from light jets faking either b jets 
or photons, or from Z bosons where one of the leptons in Z — > £'^i~ is lost and fakes missing 
transverse momentum. To estimate these backgrounds we assume the probability of a light 
jet to be misidentified as a 6 jet to be [45,46] 

= 1/100 (1/140) (29) 

at the Tevatron (LHC). For the probability of a jet to fake a photon, Pj^-y, at the Tevatron 
we use the result obtained by CDF for 10 GeV < pri'j) ^ 25 GeV in the measurement 
of the and cross sections [47], and conservatively assume that Pj-^-y is constant for 
Pt(7) > 25 GeV: 



^ _ I a ■ e-^-P^(^) for 10 GeV < pr(7) < 25 GeV, 
^'^^ ~ ^ 7 • 10-^ for pt(7) > 25 GeV, ^ ^ 



with a = 0.0079 and b = 0.097 GeV~\ The D0 Collaboration obtained a similar result [48]. 

Expectations for the probability to misidentify a light jet as a photon at the LHC vary 
between Pj^^ = 1/2500 and P^^i^ = 1/1600 [43,49-51]. In the following we take the 
conservative route and use the more pessimistic estimate Pj^-y = 1/1600 for all numerical 
studies at LHC. 

The potentially most dangerous reducible background is ttj production where one of 
the jets in the final state fakes a photon. We calculate this using exact W^W~bbj matrix 
elements, including spin correlations for the W decays. However, gluon radiation from the 
W decay products is not included. For the cuts used here, Eqs. (23-28), this should be an 
excellent approximation to the full process pp — > iubb + 3 jets. 

In Fig. 1 we show the photon transverse momentum distributions of the tt^ signal (solid 
curve), the ttj background (dotted line), the background from single top production pro- 
cesses (dashed line), and the W'-fbbjj background (histogram). There are several thousand 
Feynman diagrams contributing to Wjbbjj production. Numerical evaluation of these he- 
hcity amphtudes is very time consuming. We therefore show the W^bbjj differential cross 
section in form of a histogram, where the error bars represent the statistical uncertainty of 
the Monte Carlo integration. The tij background is seen to be a factor 2 to 10 smaller than 
the tt'y signal for the jet - photon misidentification probabilities used. The sharp kink in 
the ttj differential cross section at the Tevatron is due to the functional form of Pj^-y (see 
Eq. (30)). The {tbj + tb'j) + X and Wjbbjj backgrounds both are found to be more than 
an order of magnitude smaller the ttj background. 

The numerical results shown in Fig. 1 and all subsequent figures which display differential 
cross sections represent cross sections after selection cuts but before any particle identifica- 
tion efficiencies are taken into account. 

It should be noted that the cross sections of the tij, the {tbj + ibj) + X, and the 
W^bbjj backgrounds depend significantly on the choice of factorization and renormalization 
scales, and fiR, which were taken to be [j^f = I^^r = ^t- Including next-to-leading oder 
(NLO) corrections in most cases significantly reduces the scale dependence of a process. 
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Figure 1. The differential cross sections as a function of the photon transverse momentum 
for jivibbjj production at (a) Tevatron Run II and (b) LHC. Shown are the SM predictions 
for tt^ production (including radiative top decays in tt events, solid line), the ttj background 
where one jet is misidentified as a photon (dotted line), the background from single-top production 
processes (dashed line), and the W'jbbjj background (histogram). The cuts imposed are listed in 
Eqs. (23-28). The photon misidentification probabilities used are described in the text. No particle 
ID efficiencies are included here. 
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Unfortunately the NLO QCD corrections are not presently known for any of the background 
processes. However, at least the fij rate should eventually be well-measured in data. 

Other reducible background sources are tb+3 jet, tb+3 jet, tM~uj, M'^vj and 1^66+3 jet 
production, where one jet fakes a photon; W'^ + 4 jet production where where two jets are 
misidentified as b jets; WW + 3 jet production where one jet fakes a photon and two jets are 
misidentified as b jets; and Z'-fbbjj production where one of the leptons from the Z decay is 
lost (we implicitly mean Z/j* whenever the final state is dileptons). We find the combined 
cross section for the single-top -|- jet(s) processes to be about a factor 10 smaller than that 
for (tb'y + iky) + X production; similarly for the Wbb + 3 jet background. Since Pj^b is 
very small and we require two tagged b jets, the background from W^ + 4 jet production 
where two jets are misidentified as b jets is negligible; so is the WW + 3 jet background. 
It should be noted that for a luminosity-upgraded LHC (SLHC), Pj->b rnay dramatically 
increase with as many as one in four light jets being misidentified as a 6 quark [46]. In this 
case, the W^ + 4 jet cross section may be of the same order as that of W'ybbjj. 

Reducible Zjbbjj production contributes to the background if one of the leptons from 
Z/'j* decay is missed. We consider a lepton to be missed if it has Pt < 10 GeV or \r)\ > 2.5. 
If the lepton is within a cone of AR < 0.2 from a detected lepton and has 1 GeV < pt < 
10 GeV, the detected lepton is not considered isolated and we reject the event. In order to 
avoid the collinear singularity when the missed lepton is collinear with an observed lepton 
(which is relevant only if the the missed lepton has px < 1 GeV), we retain finite lepton 
masses in the calculation. 

With severalxlO"^ Feynman diagrams contributing, pp Z^bbjj is sufficiently com- 
plicated that it requires approximation. To estimate the Z^bbjj background we use a 
procedure similar to that described in Ref. [40]. We first calculate the ratio of the Wjbb 
and W^bbjj cross sections. We then calculate the Z^bb cross section (including 7* — > 
interference) where one of the leptons from Z/'-f* is missed, and scale it by the W'jbbjj and 
W'jbb cross section ratio. Since they entail QCD radiation from very similar subprocesses, 
the Zjbbjj/Zjbb and Wjbbjj/W'~fbb cross section ratios are expected to be approximately 
equal. At the Tevatron (LHC), we find that the estimated Zjbbjj cross section is about a 
factor 7 (2) smaller than that of W^bbjj. 

In addition to the backgrounds considered so far, •yiugbbjj events (or their fakes) may 
also be produced in double parton scattering (DPS), or from multiple interactions occurring 
from separate pj) collisions in the same bunch crossing at high- luminosity running. In 
principle, one can identify multiple interactions by a total visible energy measurement or 
by tracing some final particle tracks back to distinctly separate primary vertices, but this 
may not always be possible in practice. To estimate the cross sections from DPS and 
multiple interactions, we use the approximation outlined in Ref. [52]. At the LHC, the 
cross section from overlapping events is about a factor of two larger than that from DPS. 
At the Tevatron, for a luminosity oi £ = 10^^ cm~^s~^, DPS dominates. The resulting 
background arises predominantly from the overlap of a tt event and a two- jet event, wherein 
one jet is misidentified as a photon and the other is missed. We estimate the cross section 
for this process to be approximately 0.7 fb (0.01 fb) at the LHC (Tevatron), which is of the 
same order or smaller than for W'-fbbjj. The cross sections for the SM signal and the most 
important background processes are summarized in Table I. 

As stated before, we require that both b quarks be tagged. Requiring only one tagged 
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Table I. Expected cross sections (fb) for the ^iuibbjj signal and the most important back- 
ground processes at the Tevatron and the LHC for the cuts described in Sec. Ill A. The photon 
misidentification probabilities used are described in the text. No particle ID efficiencies are in- 
cluded. 



process Tevatron LHC 

signal 19 8L7 

tij 0.78 45.7 

{tlrf + %) + X 0.03 2.64 

W'jbbjj 0.07 0.89 

Z-fbbjj 0.01 0.43 

tt ® jj 0.01 0.7 



b quark would result in a signal cross section increase of a factor (2/eb — 1). This larger 



signal rate comes at the expense of an increased background and a reduced acceptance. In 
events where one of the b quarks is not tagged, photon radiation off the untagged b quark 
cannot be suppressed by a larger AR cut. Furthermore, to suppress the contributions from 
radiative W decay, the invariant mass cut on the jj7 system in Eq. (24) has to be imposed 
on all three possible jj'-f combinations. This reduces the signal cross section by almost a 
factor 2. In addition, for events with only one b tag, the background will be larger. The tij 
background increases by roughly 30% relative to the signal. The {tlry + tbq) +X and W'jbbjj 
backgrounds increase due to the larger combinatorial background from grouping jets, the 
tagged b quark and the £z/ system into biu^'j), jii^i'j) and bjjipi) systems which are 

compatible with (radiative) top decay. Detailed calculations are needed for a quantitative 
estimate of the increase of these backgrounds. Finally, the 11^7 + 4 jet and WW + 3 jet 
backgrounds increase by about two orders of magnitude due to the much higher probability 
that only one (instead of two) light jet is mistagged as a 6 quark. Nevertheless, they are 
still expected to be far smaller than the W'jbbjj background. Since the single-6-tagged final 
state is less "clean" than that where both b quarks are identified, we do not consider it in 
detail here. 

C. Signatures for anomalous couplings 

The photon transverse momentum distributions for — > 'jiuibbjj in the SM and for 
various anomalous tt^ couplings, together with the combined pril) distribution of the ttj, 
W'jbbjj and the (tb'j + ibj) + X backgrounds, are shown in Fig. 2. Only one coupling at 
a time is allowed to deviate from its SM prediction. At the Tevatron, the jlv^bbjj cross 
section is completely dominated by qq annihilation. As a result, photon radiation off the 
initial state quarks constitutes an irreducible background which limits the sensitivity of the 
photon differential cross section to anomalous tt^ couplings. This is particularly pronounced 
for Fjy. Even when the photon does not couple to the top quark at all (AF^y = 2/3 with 
all other ttj couplings vanishing; dashed line in Fig. 2a), the cross section hardly differs 
from the SM result. In contrast, at the LHC more than 75% of the jiuibbjj cross section 
originates from gluon fusion. This results in a greatly- increased sensitivity of the Pt{i) 
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Figure 2. The differential cross sections as a function of the photon transverse momentum for 
^£u£bbjj production at (a) Tevatron Run II and (b) LHC. Shown are the SM predictions for ttj 
production (including radiative top decays in tt events, soUd line), the combined ttj, W^bbjj and 
{tb'f + tb^) + X background (long-dashed-dotted Hne) , and the predictions for several non-standard 
tt'j couphngs. Only one coupling at a time is allowed to deviate from its SM value. The cuts 
imposed are listed in Eqs. (23-28). No particle ID efficiencies are included here. 
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distribution to non-standard tt^' couplings, which is evident from Fig. 2b. 

Non-standard vector and axial vector couplings yield a transverse momentum distribution 
for the photon with high-p^ behavior similar to that in the SM. At low photon transverse 
momenta, however, the shape of the pt distribution for SM and anomalous couplings differs. 
This is most easily noticed for /^F^y = 1 in Fig. 2b. The change in shape at low pr is due 
to radiative top decays which can contribute only in this region. Non-standard and SM 
helicity amplitudes interfere differently for tt7 production and U events where one of the 
top quarks decays radiatively, resulting in a shape change. Since the interference effects 
can be constructive or destructive, non-standard vector or axial vector couplings can either 
increase or decrease the signal cross section. 

Terms in the helicity amplitudes proportional to the dipole form factors F^yj^ grow like 
m{t'-f)/mt at high energies. Here, 'm{t'~f) is the invariant mass of the photon and the top 
quark to which it couples. This results in a transverse momentum distribution of the photon 
which is considerably harder than that of a non-standard vector or axial vector coupling. 
The long-dashed curves in Fig. 2 show the photon pt distribution for F^y — 3 {F^y = — 1) 
at the Tevatron (LHC). For equal coupling strengths, the numerical results obtained for 
are almost identical to those found for F^y. To discriminate F2y from o^^^ can take 
advantage of the CP- violating nature of ^2*^ and use the asymmetry ^cut(Prcut) introduced 
in Ref. [53]. 

Anomalous ^7 couplings also affect the single resonant {tlrf + tJrf) + X background. 
However, since the {tbj + ibj) + X background is small, this has almost no effect on the 
overall signal to background ratio, so we do not include the anomalous couplings in these 
backgrounds. 

IV. TtZ PRODUCTION 

The process pp^ ttZ leads to either i'^e''iubbjj or i'^i'~bb + 4j final states if the Z- 
boson decays leptonically and one of the W bosons decays hadronically. For both final states 
the leptonic Z decay provides an efficient trigger. If the Z boson decays into neutrinos and 
both W bosons decay hadronically, the final state consists of ^Tbb + Aj. In this case one has 
to trigger on the multijet system, similar to many supersymmetry searches. For Z ^ vv and 
one of the W bosons decaying leptonically, the tt background swamps the signal. Finally, 
for Z — > jj{bb), ttjj {ttbb) production constitutes an overwhelming irreducible background. 

In the following, we concentrate on the f+f iubbjj and £'^£'~bb + 4:j final states, which 
we henceforth refer to as the trilepton and dilcpton channels for brevity. The i''^ i'^ ii'i"u"bb 
channel, while experimentally cleaner, has a much smaller BR, so we ignore it. Due to 
the larger Z — > Pi/ BR, the '^xbb + 4j channel cross section before cuts is about a factor 3 
larger than that for the trilepton and dilepton final states. However, tt production with 
all-hadronic decays where one or more jets are badly mismeasured, and ttW production 
where the lepton from W decay is lost, constitute potentially large backgrounds. For this 
reason, we also do not consider the ^^rbb + 4j final state here. 

The signal cross section calculation proceeds similar to that in Sec. HI. As in that case, 
form factor effects turn out to unimportant and are ignored. We assume real ttZ couplings. 
As with tt7 we include all decay spin correlations and finite width effects. Here we also 
include off-shell photon interference effects with Z £'~^£'~. We take into account all 
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Feynman diagrams contributing to the trilepton and dilepton final states, including those 
where the final state W boson couples to f. To ensure gauge invariance of the SM result, 
we again use the overall-factor scheme. 

A. The tiZ trilepton final state 

In order to identify leptons, b quarks, light jets and the missing transverse momentum 
in i'~^i'~£i/bbjj events, we impose the cuts listed in Eq. (23). In addition, we require that 
there is a same-fiavor, opposite-sign lepton pair with invariant mass near the Z resonance, 

mz - 10 GeV < m{U) < + 10 GeV. (31) 

As a result of this final state signature requirement, ttZ production as observed is very 
insensitive to anomalous ttj couplings. Since there is essentially no phase space for t — > WZb 
decays {BR{t — > WZb) ^ 3 • 10~^ [54,55]), this trilepton final state arises only from ttZ 
production. Thus, in addition to the cuts listed in Eqs. (23) and (31), we require that events 
satisfy Eq. (26), i.e. that the b£u and bjj systems are consistent with top decay. 

The main backgrounds contributing to the trilepton final state are singly- resonant {tbZ + 
ibZ) -\-X (tbZjj, tbZjj, tbZii/ and ibZiu) and non-resonant WZbbjj production. As in the 
^7 case, backgrounds from DPS and overlapping events are found to be negligible. 

At the Tevatron, ttZ production is quite small, and the trilepton final state cross section 
is only about 0.02 fb, far too small to be observable for the anticipated integrated luminosity 
in Run II. We therefore consider this signature only for the LHC. The Z boson transverse 
momentum distribution is shown in Fig. 3 for the SM signal and backgrounds, as well as for 
the signal with several non-standard ttZ couplings. Only one coupling at a time is allowed to 
deviate from its SM prediction. The backgrounds are each more than one order of magnitude 
smaller than the SM signal. As in W^bbjj production, numerical evaluation of the WZbbjj 
helicity amplitudes is very time consuming. We thus show its differential cross section as a 
histogram, where the error bars represent the Monte Carlo statistical uncertainty. 

Figure 3 shows that, as in the ^7 case, the dimension five couplings ^2^^ lead to a 
significantly harder transverse momentum distribution. Furthermore, as in the case of 
and -F^^, almost identical numerical results for F^y and Fg^^ are found for equal coupling 
strengths, and a CP-violating asymmetry similar to A'^^^^pxcut) has to be used to discrimi- 
nate between the weak magnetic and weak electric dipole form factors. 

Varying F^yj^ leads mostly to a cross section normalization change, hardly affecting the 
shape of the Pt{Z) distribution. This is because, unlike in the ^7 case, there is no radiative 
top decay, i.e. no ti events where t — > WZb. This implies that, for the cuts we impose, the 
Pt{Z) distribution for SM couplings and for F^y^ = —F^y^^ are almost degenerate. 

Currently, the SM tiZ cross section is known only at LO, and has substantial factor- 
ization and renormalization scale uncertainty. Since the backgrounds are insignificant, this 
normalization uncertainty will ultimately be the limiting factor in extracting anomalous vec- 
tor and axial vector ttZ couplings, which mostly just change the normalization. To improve 
sensitivity to F^y we need an observable which changes shape in the presence of anoma- 
lous couplings. An excellent candidate is the Z i'^i'^ dilepton azimuthal opening angle, 
A$(£'£'). We show its normalized distribution for the SM and various anomalous couplings 
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Figure 3. The differential cross sections at the LHC as a function of Pt{Z) for £'~ iubbjj 
final states. Shown are the SM predictions for ttZ production (solid), the single-top background 
(dashed), the WZbbjj background (histogram), and the predictions for several non-standard ttZ 
couplings. Only one coupling at a time is allowed to deviate from its SM value. The cuts imposed 
are listed in Eqs. (23), (26) and (31). 

in Fig. 4. Anomalous vector couplings (dashed line) reduce the peaking at small opening 
angles, whereas the opposite is true for non-standard axial vector couplings (dotted line). 
The shape change is most pronounced for i^2^^. Since the Pt{Z) distribution is considerably 
harder in the presence of these couplings, the increased Z boson Lorentz boost leads to a 
decrease of A$(ff ). 



B. The ttZ dilepton final state 

As in the trilepton case, we impose the cuts of Eq. (23) to identify leptons, b quarks 
and light jets, and again require that the invariant mass satisfies Eq. (31). The main 

background arises from Zbb + 4j production, which we calculate using ALPGEN [56]. To 
adequately suppress it, we additionally require that events have at least one combination of 
jets and b quarks which fulfills the requirements 

mt - 20 GeV < m(6ijij2) < + 20 GcV, Mw - 20 GeV < m{jij2) < Mw + 20 GeV, (32) 
mt - 20 GeV < m(62j3j4) < m* + 20 GeV, Mw - 20 GeV < m{j^ji) < M^y + 20 GeV, (33) 
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Figure 4. The normalized differential signal cross sections at LHC as a function of the 
Z I'^l' azimuthal opening angle, A$(£'^'). Shown are the SM distribution (solid line) and 
the predictions for several non-standard ttZ couplings. Only one coupling at a time is allowed to 
deviate from its SM prediction. The cuts imposed are listed in Eqs. (23), (26) and (31). 

where 61,2 = b,b , and ji, i = 1, ... ,4, are the four light jets. The SM Pt{Z) distribution, 
together with those of the Zbb + 4j, singly-resonant {tbZ + tbZ) + X and non-resonant 
WZbbjj backgrounds is shown in Fig. 5. The signatures for anomalous ttZ couplings are 
similar to those in the trilepton channel, so we do not show them here. 

The non-resonant backgrounds fall much faster with Pt{Z) than the signal and singly- 
resonant background. The Zbb + Aj background is important only ior pt{Z) < 100 GeV. For 
Pt{Z) > 200 GeV, {tbZ + tbZ) + X production constitutes the largest background. Except 
for very small values of Pt{Z), the signal to background ratio (S:B) is significantly better 
than 1:1. The SM signal cross section is approximately the same size as in the dilepton 
final state. We therefore take both channels into account in extracting anomalous coupling 
sensitivity limits. Cross sections for the signal and backgrounds are summarized in Table II. 



V. LIMITS ON ANOMALOUS TOP QUARK COUPLINGS 

The shape and normalization changes of the photon or Z-boson transverse momentum 
distribution and, for tiZ production, the A$ (£'£') distribution, can be used to derive quanti- 
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Figure 5. The differential cross sections at the LHC as a function of Pt{Z) for I'^l' bb + 4j 
final states. The SM is the solid curve. Backgrounds are Zbb + Aj (dashed), single-top production 
(dotted), and WZbbjj (histogram). The cuts imposed are listed in Eqs. (23) and (31-33). 

tative sensitivity bounds on the anomalous tt'-y and ttZ couplings. We do this by performing 
a test on the distributions and calculating 68% and 95% confidence level (CL) limits. To 
calculate the statistical significance, we split the distributions into a number of bins, each 
with typically more than five events, approximating the Poisson statistics via a Gaussian 
distribution. We impose the cuts described in Sees. Ill and IV and combine channels with 
electrons and muons in the final state, conservatively assuming a common lepton identifica- 
tion efficiency of ei = 0.85 for each lepton. We take the identification efficiency for photons 
to be = 0.8 and assume a double 6-tag efficiency of = 0.25(0.4) at the Tevatron (LHC). 



Table II. Expected LHC cross sections (fb) for the ttZ trilepton and dilepton channels. The 
cuts applied are described in the text. No particle ID efficiencies are included. 



process 


I'-^l'-lubbjj 


i'^£'~bb + 4j 


signal 


2.25 


2.32 


Zbb + 4 jet 




0.43 


{tbZ + tbZ) + X 


0.12 


0.08 


WZbbjj 


0.03 


0.02 
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Except for the ttj and ttZ couplings we assume the SM to be vahd: the Wtb and ttg 
couphngs can be precisely measured at the LHC in single top [13] and tt production [57]. 
Correlations between different anomalous couplings are fully included. 

Our expression for the statistics used to compute confidence levels is [58] 



(N,-fNfr 



where ud is the number of bins, Nj, is the number of events for a given set of anomalous 
couplings, and A^^^ is the number of events in the SM in the ith bin. The parameter / reflects 
the uncertainty in SM cross section normalization within the allowed range. We determine 
it by minimizing x^'- 

{l + A^^)-^ for / < (1 + zw)-i 

/=<(/ for (l + AAT)-! </< 1 + AjV (35) 

1 + AjV for / > 1 + AjV 



with 

/"HE^^n E9^- (36) 



riD 1 no 



=1 J 1=1 * 



The parameter AjV is the SM cross section uncertainty. It arises primarily from the 
currently-unknown signal QCD corrections, and from PDF uncertainties. In the follow- 
ing we assume AjV = 30% unless stated otherwise. We universally assume real anomalous 
couplings. 



A. Sensitivity bounds for ttj couplings 

To derive sensitivity bounds for anomalous ^7 couplings, we take into account the ttj, 
singly-resonant (tbj + tbj) + X, and Wjbbjj backgrounds. The variation of the singly- 
resonant background with ttj anomalous couplings is ignored. For the probabilities that a 
jet fakes a photon at the Tevatron and LHC we use the values listed in Sec. IIIB. All other 
backgrounds are assumed to be negligible. For the Tevatron, we derive sensitivity limits 
for an integrated luminosity of 8 fb~^ which is the total integrated luminosity anticipated 
for Run II. For the LHC we calculate bounds for 30 fh'^, 300 ih-\ and 3000 fb^^ An 
integrated luminosity of 300 fh^^ corresponds to 3 years of running at the LHC design 
luminosity oi £ = 10"^^ cm^^ s^^. The smaller value of 30 fb~^ is expected for the first few 
years of operation of the LHC when the luminosity is likely to be significantly smaller than 
design. The larger value of 3000 fb~^ can be achieved in about 3 years of running at a 
luminosity-upgraded LHC. 

Our results for the Tevatron are shown in Table HI. The correlations between various 
anomalous tt'-f couplings are illustrated in Fig. 6 for two combinations, AF^y versus AF^^, 
and AF^^ versus AFg^. Correlations between the couplings are seen to be fairly small at 
Tevatron energies. This is also the case for the combinations not shown. 

Due to the small cross section and the complicating "background" from photon radiation 
off initial state quarks, Tevatron experiments are essentially insensitive to the dipole form 
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Table III. Sensitivities achievable at 68.3% and 95% CL for anomalous tt^ couplings in 
PP ~^ if-i'tbbji at the Tevatron [y/s = 2 TeV) for an integrated luminosity of 8 fb^"*^. The limits 
shown represent the maximum and minimum values obtained when taking into account the cor- 
relations between any possible pair of anomalous couplings. The cuts imposed are described in 
Sec. Ill A. 

coupling 68.3% CL 95% CL 

AP7 +1.92 +2.60 

^^^v -1.20 -1.88 

+0.69 +1.03 
^^1^ -0.82 -1.17 

AP7 +5.16 +8.49 

^^2y _5.21 -8.73 

Ap7 +5.19 +7.85 

^^2A -5.08 -8.43 



Table IV. Sensitivities achievable at 68.3% CL for anomalous ^7 couplings in pp ^(l.U(hbjj 
at the LHC = 14 TeV) for an integrated luminosities of 30 fb-\ 300 fb^^ and 3000 fb'^ The 
limits shown represent the maximum and minimum values obtained when taking into account the 
correlations between any possible pair of anomalous couplings. The cuts imposed are described in 
Sec. Ill A. 

coupling 30 fb-^ 300 fb"^ 3000 fb"^ 

/vp7 +0.23 +0.079 +0.037 

^-^1^ -0.14 -0.045 -0.019 

+0.17 +0.051 +0.018 

^^1^ -0.52 -0.077 -0.024 

+0.34 +0.19 +0.12 

^■^21/ -0.35 -0.20 -0.12 

+0.35 +0.19 +0.11 



-0.36 -0.21 -0.1: 



factors F^yj^. The achievable bounds for these are worse than the limits from ^'-matrix 
unitarity for a form factor scale h-FF>^ TeV. However, for the tt'y vector and axial vector 
couplings, which are not (directly or indirectly) constrained by any existing experiment, 
CDF and D0 will be able to perform a first, albeit not very precise, measurement. The 
prospects are most favorable for Fj^, which, as shown in Table III, can be determined with 
an accuracy of about 70% for a SM cross section normalization uncertainty of 30%. 

As shown in Fig. 6a, the precision on Fj^ can be improved to about 50% if the normaliza- 
tion uncertainty can be reduced to 10%. This depends critically on the signal normalization. 
Currently, the tt7 cross section is known only at LO. Once the NLO QCD corrections are 
known, a 10% normalization uncertainty may be realistic. 

The bound on F^j^ can, in principle, be further tightened by enlarging the signal sample 
by requiring only one 6-tagged jet. As mentioned before, the increase in signal statistics when 
including single tagged events comes at the price of increased background. To quantify the 
improvement, detailed simulations are needed. 

The sensitivity bounds achievable at the LHC are shown in Table IV and Fig. 7. Even 
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Figure 6. Projected bounds on anomalous couplings for -pp I'^i^ibbjj at the Tevatron and 
an integrated luminosity of 8 fb"-*^. Shown are 68.3% (solid) and 95% CL limits (dashed) for a SM 
cross section normalization uncertainty of AJ\f = 30%, and the 68.3% CL limits for AJ\f = 10%: 
(a) for AFj^^ versus AF^^; and (b) for AF^^ versus AF^*^. In each graph, only those couplings 
which are plotted against each other are assumed to be different from their SM values. 
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Figure 7. Projected bounds on anomalous tt^y couplings for pp —>■ ^ivfhhjj at the LHC. Shown 
are 68.3% CL limits for a SM cross section normalization uncertainty of AA/" = 30% and for 
integrated luminosities of 30 fb~^ (solid), 300 fb"^ (dashed), and 3000 fb~^ (dot-dashed): (a) for 
AF-^^ versus AF-[y, (b) for AF^^ versus AF^^, (c) for AF^^ versus AFj^^ and (d) for AF^ versus 
^F^y In each graph, only those couplings which are plotted against each other are assumed to 
be different from their SM values. 

for a modest integrated luminosity of 30 fb^^, one expects more than 500 signal events after 
acceptances and efficiencies are taken into account. This will make it possible to measure 
the ^7 vector and axial vector couplings, and the dipole form factors, with a precision of 
typically 20% and 35%, respectively. For 300 fb~^, the limits improve to 4 — 7% for F^y^ 
and to about 20% for F^y^. At the SLHC, assuming an integrated luminosity of 3000 fb~^, 
one can hope to achieve a 2 — 3% measurement of the vector and axial vector couplings, 
and a 10% measurement of -F^yA' Provided that particle identification efficiencies are not 
substantially smaller, and the reducible backgrounds not much larger, than what we have 
assumed. 

As shown in Fig. 7, with the exception of F^y and Fj^ (see Fig. 7d), there are substantial 
correlations between the tt'-y couplings at the LHC, in particular for low integrated lumi- 
nosities where small changes in the shape of the Pt{i) distribution are not resolved with the 
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Table V. Sensitivities achievable at 68.3% CL for anomalous ttZ couplings at the LHC for 
integrated luminosities of 300 fb~^, and 3000 fb~^. The limits shown represent the maximum and 
minimum values obtained when taking into account the correlations between any possible pair of 
anomalous couplings. The cuts imposed are described in Sees. Ill A and IV A. 



coupling 



300 fb" 



3000 fb" 



AFiy 



+0.87 
-0.46 

+0.15 
-0.20 

+0.52 
-0.52 

+0.54 
-0.53 



+0.62 
-0.22 

+0.056 
-0.074 

+0.30 
-0.29 

+0.30 
-0.31 



available statistics. Varying only one coupling at a time thus will produce overly optimistic 
limits. The correlations between F^y and {F2A -^iV) similar to those for F^j^ 
and (F^y and F^y) and thus not shown in Fig. 7. 



B. Sensitivity bounds for ttZ couplings 

To extract bounds on the ttZ couplings, we perform a simultaneous fit to the Pt{Z) 
and the A$ distributions, using both the trilcpton and dilepton final states. Since 
the {tbZ + ibZ) + X and WZbbjj backgrounds are very small, we take only the Zbb + 4j 
background into account in our analysis. We calculate sensitivity bounds for 300 fb~^ 
and 3000 fb~^ at the LHC; for 30 fb~^ the number of events expected is too small to yield 
meaningful results. 

Our results are shown in Table V and Fig. 8. For an integrated luminosity of 300 fb~^, 
it will be possible to measure the ttZ axial vector coupling with a precision of 15 — 20%, and 
FivA ^i^^ ^ precision of 50 — 55%. At the SLHC, these bounds can be improved by factors 
of about 1.6 {F2v^j^ and 3 {F^j^. The bounds which can be achieved for F^y are much 
weaker than those projected for F^. As mentioned in Sec. IV B, the Pt{Z) distributions 
for the SM and for F^y^^ = —F-^^y^ arc almost degenerate. This is also the case for 
the A$ distribution. In a fit to these two distributions, therefore, an area centered at 
AFfy^ = —2F^y^^ remains which cannot be excluded, even at the SLHC where one expects 
several thousand ttZ events. For F^y, the two regions merge, resulting in rather poor limits. 
For F]^, the two regions are distinct. Since the area centered at AFj^i = —2F^J^^ is 
incompatible with the indirect limits on the ttZ vector and axial vector couplings from LEP 
data, it is not included in Table V or Fig. 8. 

The bounds on the ttZ couphngs, with the exception of F^y and F^a (see Fig. 8d), are 
strongly correlated. The correlations between F^y and Fj^ {F2A and F^y) are similar to 
those for F^j^ and F^^i {F^y ^-nd F^y) and thus arc not shown. In Fig. 8a we also include 
the indirect bounds resulting from LEP data (see Eqs. (17) and (18)) for two choices of the 
loop momentum cutoff scale A. 

To test the robustness of our sensitivity hmits for anomalous ttZ couplings, we have 
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Figure 8. Projected bounds on anomalous ttZ couplings for at the LHC. Shown are 68.3% CL 
limits for integrated luminosities of 300 fb~^ (solid) and 3000 fb^^ (dashed): (a) for AF^^ versus 
AF-^^, (b) for l^F^j^ versus AF^^^, (c) for AFj^ versus AF^^ and (d) for l^F^^^ versus AF2^. In (a) 
we also include the (indirect) constraints from LEP data (see Eqs. (17) and (18)) for two choices 
of the loop momentum cutoff scale A (solid: A = 3 TeV, dashed: A = 1 TeV). In each graph, only 
those couplings which are plotted against each other are assumed to be different from their SM 
values. 

performed an independent analysis using Poisson statistics and the log-likelihood method. 
The normalization uncertainty in this approach is treated as a Gaussian fluctuation with 
standard deviation AAA. Except for F^^i, the limits obtained using the log-likelihood method 
are similar to those shown in Table V and Fig. 8; they are typically 5 — 10% more strin- 
gent. For the ttZ axial vector coupling we observe a somewhat larger variation. The same 
statement also holds for the sensitivity of the bounds on the normalization uncertainty AM. 
This is illustrated in Fig. 9, where we show 68.3% CL limits for AF^^i versus AF^y and 
300 fb~^ at the LHC, using the test described at the beginning of this section (solid 
and dashed lines), and the log-likelihood method (dotted and dot-dashed lines). For both 
methods, results are shown for AA/" = 30%, and AM = 10%. The sensitivity bounds on 
AFfj^ are seen to vary by as much as 50% with the statistical method employed, and can 
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Figure 9. Projected 68.3% CL bounds on AFf^ and AFfy for 300 fb~^ at the LHC. The 
solid and dashed curves show the sensitivity bounds obtained using the test described at the 
beginning of this section for AJ\f = 30% and AM = 10%, respectively. The dotted and dot-dashed 
lines correspond to the limits found using the log-likelihood method. All other ttZ couplings are 
assumed to have their SM values. 

be improved by as much as factor 2 if AA/" can be reduced from 30% to 10%. As in the tt^ 
case, a 10% normalization uncertainty may be realistic once the NLO QCD corrections to 
ttZ production are known. 



C. Discussion 

It is instructive to compare the bounds for anomalous ttV couplings achievable at hadron 
colliders with the indirect limits from LEP data and 6 — > S7 decays, and with those projected 
for a future e'^e" linear collider. The tt^ vector and axial vector couplings are unconstrained 
by LEP and h ^ data. Thus, the Tevatron offers a first opportunity to probe these 
couplings, although the sensitivity is severely limited by statistics and the "background" 
from initial state radiation. A much more precise measurement can be performed at the 
LHC, which will also be able to determine the dipole form factors F^y^ at the 10 — 20% 
level. Comparing the bounds on F^y (Table IV) with the indirect hmits derived in Sec. II C, 
one observes that the LHC (SLHC) can improve the current bound from h — > 57 decays by 
a factor of about 2 (5). On the other hand, the limits on F^j^ which one expects at the LHC 



25 



Table VI. Sensitivities achievable at 68.3% CL for the anomalous ttV {V = 7, Z) couplings 
^WA ^2V A (^) LHC for integrated luminosities of 300 fb~^, and at an e~^e~ 

linear collider operating at y/s = 500 GeV (taken from Ref. [19]). Only one coupling at a time is 
allowed to deviate from its SM value. 



coupling LHC, 300 fb-^ e+e" [19] 





+0.043 

-0.041 

+0.051 
-0.048 

+0.038 
-0.035 

+0.16 
-0.17 


+0-047 200 fb-i 
-0.047 ' "^^^ 

+0-011 lOOfb-i 
-0.011 ' ^'^ 

+0.038 200 fb-i 
-0.038 ' 

+0-014 loofb-i 
-0.014 ' 


AF^y 

^FlA 

AFiy 

A^2A 


+0.43 
-0.83 

+0.14 
-0.14 

+0.38 
-0.50 

+0.50 
-0.51 


+0.012 200 fb-i 
-0.012 ' 

+0.013 ^QQ^-i 
-0.013 ' 

+0.009 200 fb-i 
-0.009 ' 

+0.052 loOfb-i 
-0.052 ' 



are at least one order of magnitude more stringent than those from 6 — > 57, if one assumes 
to be real. 

The ei and parameters constrain the ttZ vector and axial vector couplings to within a 
few percent of their SM values if one assumes that no other source of new physics contributes 
to these parameters. Table V and Fig. 8a show that it will be impossible to match that 
precision at the LHC, even for an integrated luminosity of 3000 fb~^. In contrast, €2 and €3 
only constrain a linear combination of and F^^^. Thus, tiZ production at the LHC will 
provide valuable information on the dimension-five ttZ couplings. 

The most complete study of ti production at a future e+e^ linear collider for general ttV 
{V — 7, Z) couphngs so far is that of Ref. [19]. It uses the parameterization of Eq. (5) for 
the ttV vertex function. In order to compare the bounds of Ref. [19] with those anticipated 
at the LHC, the limits derived in Sees. VA and VB have to be converted into bounds on 
F^j^ and F^^/j^ (see Eqs. (6-9)). Table VI compares the bounds we obtain for F^^ and 

F^vA "with those reported in Ref. [19] for an e~^e~ linear collider operating at ^/s = 500 GeV, 
which assumes a linear polarization ofV~ = = 0.8 for both electron and positron beams. 
Ref. [19] hsts sensitivity bounds only for the case that only one couphng at a time is allowed 
to deviate from its SM value, as we do for the LHC in Table VI. Furthermore, we show limits 
only for an integrated luminosity of 300 fb^^. The results of Table VI demonstrate that a 
linear collider, with the exception of F^y and Fi^y, will be able to considerably improve the 
sensitivity limits which can be achieved at the LHC, in particular for the ttZ couplings. For 
the SLHC, with 3000 fb"^, we obtain bounds for the anomalous ttV couplings which are a 
factor 2 — 3 more stringent than those shown in Table VI. Thus, even if the SLHC operates 
first, a linear collider will still be able to improve the ttZ anomalous coupling limits by at 
least a factor 3. It should be noted, however, that this picture could change once correlations 
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between different non-standard ttV couplings are taken into account. Unfortunately, so far, 
no realistic studies for e^e~ ti which include these correlations have been performed. We 
found that there are significant correlations between the various ttV couplings at the LHC. 
Since both tt'y and ttZ contribute to e^e~ — > tt, the correlations may even be larger at a 
e^e' linear collider. More detailed studies are needed in order to answer this question. 

Our calculation of sensitivity bounds is subject to several uncertainties. The cross sec- 
tions of the main backgrounds, ttj and Zbb + Aj production, are proportional to and a^, 
respectively, whereas the signal cross section scales as a^. The background thus depends 
more strongly on the factorization and renormahzation scale than the signal. The back- 
ground normalization can be fixed by relaxing the ^7 (Eqs. (23-28)) or ttZ selection cuts 
(Eqs. (23), (26) and (31 - 33)), measuring the cross section in that background-dominated 
region of phase space, and then extrapolating back to the analysis region. Since tij produc- 
tion is the dominant source of background in the tij case, S:B sensitively depends on the 
jet photon misidentification probability, Pj^-y. This has been measured at the Tevatron, at 
least for small values of the photon transverse momentum. For the LHC, we have relied 
on ATLAS and CMS simulations. Finally, in calculating limits we have ignored the back- 
ground from W^7+jets and WZ+ jets production, where two of the jets are misidentified as 
6-quarks. While these backgrounds should be very small at the Tevatron and LHC, they may 
be more important at the SLHC. Fortunately, the total background for both ^7 and tiZ 
production is relatively small and hardly affects the ultimate sensitivity limits. Increasing 
the background cross section by a factor 2, for example, weakens the bounds by only a few 
percent. 

In our analysis, we have assumed that both b quarks are tagged. If events with only one 
b tag can be utilized, the sensitivity bounds can be improved by up to a factor 1.5. However, 
detailed background calculations are needed before a firm conclusion can be drawn. The 
same statement applies to the '^rbb + Aj final state, which has the potential of improving the 
sensitivity limits for anomalous ttZ couplings by as much as a factor 1.7. Finally, we stress 
that our calculation was based on a simple test. More powerful statistical tools such as 
those used in the recent re-analysis of the top quark mass [4] , or a neural net analysis, may 
further improve the limits. 

VI. SUMMARY AND CONCLUSIONS 

Currently, little is known about top quark couplings to the photon and Z boson. There 
are no direct measurements of these couplings; indirect measurements, using LEP data, 
tightly constrain only the ttZ vector and axial vector couplings. All others are only very 
weakly constrained by LEP and/or 6 — > 57 data. The ttV {V — 7, Z) couphngs can be 
measured directly in e'^e~ — > at a future e'^e~ linear collider. However, such a machine 
is at least a decade away. In addition, the process e~^e~ ti is simultaneously sensitive to 
^7 and ttZ couplings, and significant cancellations between various couplings may occur. 

In this paper, we have considered ^7 production (including radiative top decay, t Wbj, 
in ti events) and tiZ production at hadron colliders as tools to measure the ttV couplings. 
We calculated the signal cross sections, taking into account the full set of contributing 
Feynman diagrams. In ti'-f production, we concentrated on the '-fiubbjj final state. For tiZ 
production, we assumed that the Z boson decays leptonically, Z —>■ £'~^£'~ , and investigated 
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the £''^£'~£i'bbjj (trilcpton) and C!^ C.'~hb + Aj (dilepton) final states. All relevant background 
processes were included. Once tt7 or ttZ selection cuts are imposed, the total background 
is substantially smaller than the signal. The dominant background source for ti^ events is 
QCD ttj production, where one jet is misidentified as a photon. For ttZ production, Zbb+4j 
production and singly-resonant processes are the main sources. In all our calculations we 
assumed that both b quarks are tagged. 

At the Tevatron, the ttZ cross section is too small to be observable. The tt'-f cross 
section is large enough to allow for a first, albeit not very precise, test of the tt^ vector and 
axial vector couplings, provided that an integrated luminosity of more than 5 fb^^ can be 
accumulated. No useful limits on the dipole form factors F^y^^ can be obtained. Since qq 
annihilation dominates at Tevatron energies, initial state photon radiation severely limits 
the sensitivity of tt'-f production to anomalous top quark couplings. 

This is not the case at the LHC where gluon fusion is the dominant production mecha- 
nism. Combined with a much larger cross section, this results in much-improved sensitivity 
limits. Already with an integrated luminosity of 30 fb~^, which is expected after the first 

3 years of operation, one can probe the tt^ couplings with a precision of about 10 — 35% per 
experiment. With 300 fb^^, which corresponds to 3 years of running at design luminosity, a 

4 — 7% measurement of the tt'-f vector and axial vector couplings can be expected, while the 
dipole form factors ^21/^ can be measured with 20% accuracy. Finally, if the luminosity of 
the LHC can be upgraded by a factor of 10 (the SLHC program) without significant loss of 
particle detection efficiency for photons, leptons and b quarks, these limits can be improved 
by another factor 2 — 3. 

The ttZ cross section with leptonic Z decays is roughly a factor 20 smaller than the 
ttj rate. It is therefore not surprising that the sensitivity limits on the ttZ couplings are 
significantly weaker than those which one expects for the ^7 couplings. We found that, 
for 300 fb~^, the ttZ vector (axial vector) couplings can be measured with a precision of 
45 - 85% (15 - 20%), and F^y,^ with a precision of 50 - 55%. At the SLHC, these bounds 
can be improved by factors of 1.4 — 2 (^ 3) and 1.6, respectively. 

In our analysis, we conservatively assumed that both b quarks are tagged, and used a 
simple test to derive sensitivity limits. If single-6-tag events can be utilized, the sensitivity 
bounds can be significantly strengthened. Further improvements could also result from using 
more powerful statistical tools, similar to those which have been used recently to measure 
the top quark mass [4]. 
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